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1 Introduction, SCRMs and Lovasz-Schrijver proce- 
dures 

Since 1960's, complementarity problems attracted a very significant attention in the theory 
as well as applications of operations research. See, for instance, the book on LCP ||. In this 
paper, we consider various complementarity problems in the context of Successive Convex 
Relaxation Methods (SCRMs) proposed by the authors H |J. Since these methods can be 
used to compute the convex hull of any compact subset of an Euclidean space described by 
a system of quadratic inequalities and a compact convex set, they can be used to attack 
many complementarity problems from several angles. 

In the special case of 0-1 optimization problems over convex sets, or more specially 
polytopes, there are many Successive Convex Relaxation Methods (SCRMs) based on lift- 
and-project techniques. We also discuss some of the relationships of general SCRMs and 
these more specialized algorithms in solving LCPs. 

Let F be a compact set in the n-dimensional Euclidean space R n . SCRMs take as input, 
a compact convex subset Co of R n and a set Vf of quadratic functions which induce a 
description of F such that 

F = {x G C : qf(x; 7, q, Q) < 0, qf(-; 7, q, Q) G V F }. 

Here we denote by qf(-] 7, q, Q), the quadratic function (7 + 2q T x + x T Qx). Note that the 
variable x is irrelevant outside a context and it will always be clear what the variable vector 
is, from the context. 

Let i be an integer such that 1 < 2i < m, d G R m , and let A be a compact convex 
subset of R m . Consider the convex optimization problem with complementarity conditions: 

maximize d T u 

subject to u <E A, < Ui, < u i+ g, UiUi + e = 0, Vi G {1,2,..., £}. 

First of all, it is clear that LCP, with a known upper bound on a solution of it, is a special 
case of (|l]) (we can take m — 21 and A as an affine subspace intersected with a large enough 
ball). Secondly, it is very elementary to formulate this problem as a mixed 0-1 optimization 
problem with convex constraints: 

maximize c T v 

subject to v G C , v j G {0, 1}, Vz G {m + 1, m + 2, . . . , n}, 

where 

I d I e- r>m+e 

V J ' 
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C 



n 



v 



( u \ 



G R 



u e A, 



< u i+ e < r(l - v m+i ) 
Vie {1,2,. ..,.*} 



= m + £, r > max {max{uj : u G i}} 



In general, we allow Co to be an arbitrary compact convex set in R n . There are various 
successive convex relaxation methods that can be applied to such a problem. 

We can represent the feasible region F C R n of (0) as 

F = {v G Co : p(v) < 0, Vp(-) G V F }, 
where Vf denotes a set consisting of quadratic functions 

(vf - Vi), (-vf + Vi), % G {m + 1, m + 2, . . . , n} 

on R n . 

In connection with the SCRMs and also the Lovasz-Schrijver procedures (see ||), it 
seems convenient to introduce the following notation: For every compact convex relaxation 
C C C of F and every subset D of D = {d G R n : = 1}, 



P 2 (C,D) 



SS+(C,D) 



{-(d T v - a(C , d))(d T v - a(C, d)):deD, d G D} 

3V G S n such that 
v G C : 7 + 2q T v + Q • V < 0, 

Wqf(-, 7 ,q,Q)eV F UV 2 (C,D) 

a Semi- Infinite LP relaxation of F), 

1 v T \ 
v V J 
7 + 2q T v + Q • V < 0, 

W(-,i,q,Q)ev F uv 2 (c,D) 

an SDP relaxation of F), 



3V G 5 n such that 



G 



where a(C, d) = max{d v : v G C} for every d E D. Let <S n and 5+ +n denote the set of 
n x n symmetric matrices and the set of (1 + n) x (1 + n) symmetric positive semi definite 
matrices, respectively. The corresponding variants of Successive Semi- Infinite LP Relaxation 
Method (SSILPRM) and Successive SDP Relaxation Method (SSDPRM) can be written as 
follows. 



Algorithm 1.1. (SSILPRM) 

Step 0: Choose a Do C D. Let k = 0. 

Step 1: If Ck = (the convex hull of F), then stop. 

Step 2: Let C k+1 =Af(C k , Do). 

Step 3: Let k = k + 1, and go to Step 1. 



Algorithm 1.2. (SSDPRM) 



Steps 0, 1 and 3: The same as the Steps 0, 1 and 3 of Algorithm |TTT 
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Step 2: Let C k+1 = Af+(C k ,D ). 



To connect these algorithms to the Lovasz-Schrijver procedures, we need to introduce 
some additional notation. For every pair of closed convex cones /C and T in R l+n , define 

/ x x T x A > 0, v e C , V e S n , 

M(JC,T) = {Y=[ : v i = V ii , ie {m + l,m + 2,...,n}, 

V ' v T Yw>0,VveT*,VweJC* 

/ A Xv t \ A > 0, v G C , V G S n , Y e S\ +n ^ 
M+{K,T) = {Y = I Zr )■ Vi = V«, ie {m+l,m + 2,...,n}, 

v > v T Yw>0,WveT\VwelC* 



Let T and /C be closed convex cones given by 

f a(C ,d) 



1 o 



/C 



c.cone ^ 



d 



G R 1+n : d G Dn 



G R 1+n : v G C , A > J> . 



(Note that T itself is defined as the dual of Tq.) If C C Co is a compact convex relaxation 
of F and 



then 



K -- 



A 

At; 



G i? 1+m : v E C, A > 



v G i? n : 
v ER n : 



1 


r 

V 




V 


1 


T 

V 




V 



GM(/C,T )j 

G^ + (/c,r ) 



Algorithms |LT| and [L2] specialized to (0) with V f = {vf — Vi, —vf + Vi, i G {m + 1, m + 
2, . . . ,n}} can be stated in the following forms, which are essentially the Lovasz-Schrijver 
procedures. 



Algorithm |1.1[ H (Homogeneous form of Algorithm |1 . 1|) 



Step 0: Choose a D C D. Define T and /Co as above. Let k — 0. 

7 r 



Step 1: If /Cfc = c.cone 



v 



: v G F > then stop. 



Step 2: Let /C fc+1 = {re : F G A4(/C fc , T )}. 
Step 3: Let A; = k + 1, and go to Step 1. 



Algorithm |1.2[ H (Homogeneous form of Algorithm |1.2|) 
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Steps 0, 1 and 3: The same as Steps 0, 1 and 3 of Algorithm |L2[H, respectively. 
Step 2: Let K k+1 = {Ye : Y G M+{1C k , T )}. 

In this paper ej denotes the jth unit vector and e denotes the vector of all ones (the 
dimensions of the vectors will be clear from the context). 

2 SCRMs applied to LCP with an a priori bound 

Let M G R £x£ , q G R e be given. Consider the LCP in the following form. 

(LCP) Find x, s such that Mx + q = s, 

x > 0, s > 0, 
x iSi = 0, V« G {1,2,..., £}. 

Suppose we are given £>(£, r) = ju G -R 2 ^ : ||u — ^|| < r|, an Euclidean ball containing 
a solution of the LCP. (In the case of rational data (M, q), we can take B centered at the 
origin with the radius bounded above by a polynomial function of the "bit size" of the data 
(M, q).) For the rest of this section, we assume that the Euclidean ball with center £ = 
and the radius r (r is assumed given) contains some solution of the LCP. 

Under the boundedness assumption above, it is particularly easy to model any LCP as 
a 0-1 mixed integer programming problem, since the only nonlinear constraints of LCP can 
be expressed as 

Xi = 0, or Si = 0, Vi G {1,2, ...,£}. 

Balas' method [|I|] can be directly applied to such formulations. We can also apply some 
variants of the Lovasz-Schrijver procedures || to the mixed integer programming feasibility 
problem: 

Find x, s and z such that Mx + q = s, 

< x < rz, < s < r(e — z), 

ze{0,i} e . 

Note that we can eliminate the variable vector s from the formulation and apply the 
SSILPR and SSDPR Methods to the following formulation: 

< Mx + q < r(e-z), 

< z < e, < x < rz, 

zt-Zi < 0, -zf + Zi < 0, ie {1,2,. ..,£}. 

To apply the SCRMs, we can take 

r - L - ( x \ ^ m . < Mx + q < r(e - z), \ 
°° = \ V ~{z ) eR ■ < z < e, < x < rzj> 

in = £, n = 2£, 

= {(f 4 2 -fj), (-v? + Vi), i G {m + l,m + 2, . . . . 
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Both algorithms, SSILPRM and SSDPRM presented in Section 1, terminate in at most 
£ steps. This fact can be proved easily, using the results of Balas |IJ, Sherali and Adams 
[TOU ? Lovasz and Schrijver ||, or Kojima and Tungel []5], |6j. For computational experience on 
similar algorithms for similar problems see H, [fT^j . In the next section, we give the details 
of a proof of such a convergence result when the methods are applied to a formulation of 
Pardalos and Rosen 0. 



3 SCRMs applied to Pardalos- Rosen formulation of 
LCP 

We will illustrate the convergence proof on a formulation of (LCP) by Pardalos and Rosen 
They homogenize the vector q with a new continuous variable a, then they maximize 

a. 

(MIP Q ) maximize a 

subject to < M x + qa < e — z, 

< x < z, < a < 1, z e {0,1}*. 

(a\ 

Note that x = is feasible in (MIP a ) and, it is easy to see that (MIP Q ) has an optimal 

w 

( a 

solution with a* > iff the (LCP) has a solution (or solutions) |§. Moreover, if 









C = < 













x" I IS 

X* 

an optimal solution of (MIP a ) with a* > then — solves the (LCP) M. One advantage 

a* 

of (MIP Q ) is that it does not require the introduction of large, data dependent constants 
(such as r in the previous section) or their a priori estimates. Now, we take 

,i+2£ < Mx + qa < e — z, 
L : < x < z, 0<a<l 

m = £ + 1, n = 2£ + l, 

V F = {{v^-Vi), {-v^ + Vi), i G {m+ l,m + 2,...,n}}. 

We have an analog of a very elementary but also a key lemma (Lemma 1.3 of ||) of 
Lovasz and Schrijver (and their proof technique is adapted here). In what follows, we refer 
to the vectors in the space of JCk by v. At the same time, we refer to different subvectors 
of v by different names, such as x, a etc., to keep the correspondence of elements of v and 
the original formulation of F clearer. The proof of Lemma 1.3 of [§] leads to the following 
analogous result in our case. 

Lemma 3.1. Let D D {±e m+1 , ±e m+2 , . . . , ±e„}. Then the sequence of convex cones 
{JCk '■ k > 0} given by Algorithm 1.1H satisfies 

Kfc+l C (/C fc D {v : Xi = 0}) + {JC k D {v : (Mx + qa)i = 0}) , 

for every i G {1, 2, . . . , £}, and for every k > 0. 
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f 1 \ 



Proof: Let w 



of Do and T n 



a: 
x 

the unit vector eo is in Tq 



G /Cfc+i. Fix j G {1, 2, . . . , £} arbitrarily. By the definition 



Hence, by the definition of .M(/Cfc,T ) 



A^fc+i ^ A^fc for every k > 0. Therefore, u> G /Cfc. If = or (Mx + qa)j = then the 
statement of the lemma clearly holds. So, without loss of generality, we assume Xj > 
and (Mx + qa)j > 0. Let Y G Ai(JCk,To) such that w = Ye^. By our choice of the 
cone T , we conclude that Ye n+ j and Y(e — e n+ j) are both in JCk- Note that 



w + w, 



where w = Ye n+ j and w = l^(eo — e n+ j). We will refer to the a? and z parts of the vector 
w by x, z etc. (Similarly for w.) First, since by the definition of .M(/Cfc,T ), fj = Va 
for every i G {m + 1, m + 2, . . . , n}, we have Zj = which implies Xj = 0. Therefore, w; 
lies in the cone (/Co H : = 0}). Second, since Xj > 0, z 3 - must be positive. Therefore, 
(l/zj)w G /Cq. Since Vi = Va for every i G {m + 1, m + 2, . . . , n}, zj = Zj. So, 



G Ck, 



with its Zj entry equal to 1. Thus, (Mx + qa)j = 0. Hence, w is in the cone 

(/Cfc fl {v : (Afa? + = 0}). Since the argument above is independent of the index j 

the proof is complete. | 

Note that the conclusion of the above lemma also applies to the SSDPR Method since 
SSDPR Method yields at least as tight relaxations as the SSILPR Method. 

Theorem 3.2. Both algorithms, Algorithm 1.1H and 1.2H terminate in i iterations when 
applied to the formulation (MIP a ) with our choice ofVp, Cq and D above. 



Proof: First note that 

c.hull(F) C 




f 1 \ 

a 

x 



G/G 



VA; > 0. 



Next, let i,j G {1, 2, . . . , £}, i j. Since x > and Mx + qa > 0, for all v G K-k, for 
every k > 0, 

[(/C fc n {v : x t = 0}) + (JC k n {v : (Mx + qa)i = 0})] n {v : x } = 0} 
= (JC k n {v : Xi = 0, xj = 0}) + (fC k n : xj = 0, (Mx + qfa)< = 0}) . 



Similarly, for the intersection with {v : (Mx + qa)j = 0} . Now, we apply Lemma |0 
repeatedly to conclude that /Q is the homogenization of the convex hull of all solutions 
of the LCP that lie in the original relaxation Cq- i 
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4 SCRMs applied to the smaller formulation of LCP 
with explicit treatment of disjunctive constraints 



Now, we consider a formulation with fewer variables and constraints. 



(LCP Q ) maximize a 

subject to Mx + qa > 0, x > 0, a > 0, 
e T {M + I)x + (e T q + l)a < 1, 
Xi(Mx + qa)i = 0, i <E {1, 2, . . . , £} 



It is easy to see that ( X _ j = is feasible in (LCP a ), and it is also easy to observe that 

(LCP Q ) has an optimal solution with a* > iff the (LCP) has a solution(or solutions). 

/ x* \ x* 
Moreover, if f # j is an optimal solution of (LCP a ) with a* > then — solves the (LCP). 











C = | 


H 















Note that the inclusion in Lemma |3.1| can sometimes be strict for the SSILPR and SSDPR 
Methods. 

We explicitly include the variable vector s in our discussion in this section, for the sake 
of presentation. Let 

s = Mx + qa > 0, x > 0, a > 0, 
e T (M + I)x + (e T q + I) a < 1, 

In this section, we will describe another Successive Convex Relaxation Method based on the 
ideas of Balas [|TJ, Lovasz and Schrijver ||. This method will use only Linear Programming 
(LP) relaxations. We describe the method in the original space of F and C . Let ^(Co) 
denote the set of facet defining inequalities for C . ^(Co) is the input of the algorithm 
which we introduce now. 

Algorithm 4.1. Step 0. k = 0. 
Step 1. F{C h+l )=F{C k ). 
Step 2. For every inequality 

i 

- ( u i x i + ue+iSi) - u 2 i+\a < u 
i=i 

in F{Ck) and every j 6 {1,2,..., £} solve the LP problems 

TAj) 



and 



(Pj) minimize u £ 

subject to Cf = 1, &j = °> G ^, 



{Pe+j) minimize u T $} e ' + ^ 

subject to = 0, = 1, ^ E K h . 
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If (Pj) is infeasible then add the equation Xj = (or the inequality Xj < 0, since the 
inequality Xj > is already included) to T(Ck+i). If (Pe+j) is infeasible then add the 
equation Sj = to F(Ck+i)- Otherwise, let and (£^ + ^)* denote the optimal solutions 

of (Pj) and (Pe+j) respectively. Define yj = uj - u T (^)*, y i+j = u e+j - u T (£ (£+j) )*. Add 
the inequality 

- ( u i x i + u t+i s i) ~ Hj x j ~ y^+jSj - u 2£+1 a < u 

to F(C k+1 ). 

Step 3. Let k = k + 1, and go to Step 1. 

Note that in iteration k, the algorithm solves (2l\T(C k )\) LP problems. 
Theorem 4.2. Let C k , k G {1,2,...} be the sequence of convex relaxations generated by 



Algorithm ^A . Then Q = c.hull(F). 



Proof: We think of K k for all k > 0, as a subset of R 1+(2t+l \ with the 0th compo- 
nent being the homogenizing variable, the next I components representing cc, the next I 
components representing s and the last component representing a. Note that 

£i C (/C n {v : Sj- = 0}) + (/C n {v : Sj = 0}) 

iff 

Jd d (£* + {- e j}) n (/C* + {-e^}) . (3) 

(We used the fact that /C C #+ +(2m) .) Therefore, if we ensure the latter inclusion, then 
Theorem |3.2| applies and we can conclude the convergence of the method in i iterations. 
Recall that every vector u G /Cq represents a valid inequality 

e 

- (uiXi + u e+i Si) - u 2 £+ia < u Q 

8=1 

for Co. To ensure the inclusion ([|), it suffices to prove: 

"For every u,wE /Cg such that Ui = Wi, Wi ^ {j, £ + j}',Uj > Wj, Ui+j < Wi+j, 

we have y G JC\, where yi = Ui, Vz 7^ j; = Wj." 
This is equivalent to proving the fact that if the two inequalities 

t 

- ^ (uiXi + u i+i Si) - u 2e+1 a < Uq, and 

i=l 

- ^ (MiXj + - WjXj - w e+j Sj - u 2 e+ia < u 



are valid for Cn, then 



^ (UiXi + Mf+jSi) - WjXj - Ui+jSj - M2f+1« < Mo 
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is valid for C\. To compute all such inequalities defining Ci, we solve for every valid 
inequality 

i 

- ^2 ( u i x i + Ui+iSi) - u 2f , + ia < u Q 
i=i 

for Cq and every j G {1, 2, . . . , £}, the linear programming problems 

maximize f3 

subject to fiej + 5ep + j ^jq u, 

and 

maximize 7 

subject to Kej + -yee + j u. 

Here, denotes the partial order induced by the convex cone /Cq (that is, u 1 ^j^* u 2 
iff (u 2 — it 1 ) e /Cq). Note that both problems are always feasible. Therefore, each of them 
either has an optimal solution or is unbounded. If both LPs have optimal solutions, say 
(3* and 7* then we set Wj = Uj — [3* and ue+j = ue + j — 7*. Since the above two problems 
are LPs, we can equivalently solve their duals. Namely, we solve the LPs: 

(Pj) minimize u T $}-^ 



subject to if = 1, Ci2j = °> € U) e 



and 



TM+j) 



(Pi+j) minimize u £ 

subjcet to if +3) = 0, = 1, a [e+j) e JC . 

These latter two linear programming problems are precisely the ones used by Algorithm 
[4.1| . Notice that since their duals are either unbounded or have optimal solutions, these 
LP problems either have optimal solutions or are infeasible. When (Pj) is infeasible, the 
equality Xj = is valid for F and the algorithm adds this equality to the describing 
inequalities of Ck- Similarly, when (Pi+j) is infeasible, Sj = is valid for F and the 
algorithm behaves correctly in this instance. (In either instance, the inclusion (0) is 
obviously satisfied for j.) However, the proof is not yet complete; because, the arguments 
so far ensure the inclusion (|3|) when the algorithm is ran for every valid inequality of Co. 
So, next we prove that what the algorithm does (using only the facets of Cq) suffices. To 
see this, we need to prove that to derive the facets of /Ci, it suffices to start with a facet 
u of /C in the above procedure. Suppose u, w e /Cq satisfy the above conditions but u is 
not facet inducing for /Cq. (We will prove that the valid inequality derived from u and w 
is implied by some other inequalities derived from some facets u 1 , u 2 , . . . , u e of /Co.) Since 
u is not facet inducing for /Co, u is not an extreme ray of /Cq. Hence, there exist extreme 
rays it 1 , it 2 , . . . , u e of /Cq such that for some A r > 0, r £ {1,2,..., £}, J2r=i A r = 1 the 
following conditions are satisfied: 



it 



K-u r , u r = M , Vr G {1, 2, 
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Note that u r is facet inducing for each r. Let £ r be the optimal solution of (Pj) above for 
the objective function vector u r . Let be an optimal solution of (Pj) when the objective 
function vector is u. We claim that there exists £ G /Co such that 



.r\T j- c..r\T>r 



u-rt = If 



r, Vre{i,2,. ..,£}, = 1, 6+i = 0, ^/C . 



(This claim follows from Farkas' Lemma, using the facts that u r G /Cq, Vr and £ r G /C , Vr.) 
Thus, we have 



r=l 

Therefore, the inequality obtained from it is equivalent to or dominated by a nonnegative 
combination of the inequalities obtained from u r which induce facets of /Co- The proof is 
complete. | 

We illustrated a derivation and convergence proof for a successive relaxation method 
(closely related to Balas' approach and analogous to a suggestion of Lovasz and Schrijver 



H) based on Lemma |371| and Theorem |37j|. Algorithm |4.1| is an analog of a method based on 
relaxations Nq(JC) from (which is concerned with the case of 0-1 integer programming). 
For the relationship of the methods of Q and ||, see Balas, Ceria and Cornuejols 0. (Balas' 
method M, in essence, corresponds to defining 



K k+X = (/C fc n {v : x k+1 = 0}) + (/C D {v : (Mx + qa) k+1 = 0}) .) 



Let k > denote the projection of C k generated by Algorithm |4.1| onto the coor- 
x 

OL . 

a 

(4) 



dinates ( ^ ). Let C^ 3 " 1 , k > denote the projection of generated by Algorithm 1.1, as 



used in Section 3, onto the coordinates ( ). Let K k denote the convex cone associated 



with C k . From the proof of Theorem O, it is easy to see that 

4?i = n [{^ ^{v.x l = 0}) + (4 4) n {v : s t = 0} 



i=l 



Therefore, the proofs of Theorems and [472] imply that 

if C { q ] D C^ 3) then C^ 4) D Cf ] for all k > 0. 

Thus, the SSILPR Method (Algorithm 1.1) as applied in Section 3 to (MIP a ) converges at 
least as fast as Algorithm [11] applied to (LCP Q ). 



5 SCRMs applied to the smaller formulation of LCP 
with an implicit treatment of the disjunctive con- 
straints 

We have already seen various ways of applying SCRMs to LCP problems. Since the methods 
proposed in |5|, || only require a formulation of the feasible solutions by quadratic inequali- 
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ties, we are also interested in applying the methods of B |6|] to the following formulation: 



C 

and 



a\ r£+ i Mx + qa > 0, x > 0, a > 0, 
x) EK : e T (M + I)x + (e T q + l)a < 1 



V F = {xi(Mx + qa)i < 0, % G {1, 2, ...,£}} . 

The general theory of Kojima-Tungel || implies that their SSDPR and SSILPR Methods 
converge. It would be interesting to characterize the conditions under which the Algorithms 
3.1 and 3.2 of || converge in at most £ iterations for the above description of Vp and C . 
Also see 0, where the authors derived some necessary and some sufficient conditions for 
the finite convergence of SCRMs. 



6 A general linear complementarity problem 

Let A : R e —> R , a linear transformation, q G R e and Cci? f a pointed, closed convex 
cone with nonempty interior, be given. Consider the Complementarity Problem (CP): 

(CP) Find x, s such that A(x) + q = s, 

x G /C, s G /C*, (x,s) = 0, 

where /C* is the dual of /C: 

/C* = {seR 1 : (x,s) > 0, Va;G/C}. 
Since fC is a pointed, closed convex cone with nonempty interior, so is fC* . Such problems 



were studied recently, in the context of interior-point methods [11]. We pick r\ G int(/C), 
f) G int(/C*) and we can solve instead the optimization problem 

(CP Q ) maximize a 

subject to x G /C, [A(x) + qa] G /C*, a > 0, 
(fy, a;) + (77, ^l(x) + qra) + a < 1, 
(cc,^(£c) + aq) = 0. 

We choose 

r = \( a \(z p^+i x e JC, [A(x)+qa] E JC*, a > 0, 1 
°°-\U; ' (r7,x) + (r/,^( a; ) + qa) + « < 1 /' 

Note that Cq is always a compact convex set (see the next theorem). We also pick 

V F = { (aj,^4(aj)+ag), -(x,A{x) + aq) }. 



Theorem 6.1. (%) Cq is a compact convex set. 
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(ii) (CP a ) has an optimal solution with a* > iff (CP) has a solution (or solutions). 



a 



(Hi) If I * j is an optimal solution of ( CP a ) with a* > then the pair of vectors 
^,-^A(x*) + q) solves (CP). 



cr cr 



Proof: 

(i) We only need to show that Co is bounded; because, Co is a closed and convex subset of 
R e+1 by definition. Assume on the contrary that we can take an unbounded direction 

( Ajt ) ^ °' Ax e /C ' A ° ~ °' ^ Ax ^ + qAo ^ e K *' 
(fj, Ax) + (77, A(Ax) + qAa) + Aa < 0. 

Since each term in the left hand side of the last inequality is nonnegative, we have 

(77, Ace) = and Aa = 0. 

Since f) e int(/C*) and Ax G /C, the first identity above implies that Ace = 0. Thus, 



we have a contradiction to ( Aa ~) 7^ 0. 



(ii) Suppose (CP Q ) has an optimal solution [ X *J with a* > 0. Then x = — E /C, 



s = — A(x*) + q e JC*. We have 

a* 



(x,s) = (x,A(x) + q) = —^(x*,A(x*) + a*q)=0. 

[(X ' 



Therefore, (x, s) solves (CP). For the converse, let (x, s) be a solution of (CP). Let 

1 x 
( = (rj, x) + (77, s) > 0, a* = - — - and x* 



C+i C+i 

Then ( ^ ^ is a feasible solution of (CP a ). But the feasible region of (CP a ) is compact 

and nonempty, its objective function is linear, hence, (CP Q ) has optimal solution (or 
solutions). Since we already showed a solution with positive objective value, the 
optimum value is positive. 

(iii) This claim follows from the proof of (ii). 



Theorem |TT] shows that we can apply SCRMs to (CP C 
solve the original, general problem (CP). 



with the above Co and V f and 
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